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Abstract 

This paper proposes a methodology to stabilize relative equilibria in a model of identical, steered particles moving in three- 
dimensional Euclidean space. Exploiting the Lie group structure of the resulting dynamical system, the stabilization problem 
is reduced to a consensus problem on the Lie algebra. The resulting equilibria correspond to parallel, circular and helical 
formations. We first derive the stabilizing control laws in the presence of all-to-all communication. Providing each agent 
with a consensus estimator, we then extend the results to a general setting that allows for unidirectional and time-varying 
communication topologies. 
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1 Introduction 

The problem of controlling the formation of a group of 
autonomous systems has received a lot of attention in 
recent years. This interest is principally due to the theo- 
retical aspects that couple graph theoretic and dynami- 
cal systems concepts, and to the vast number of applica- 
tions. Applications range from sensor networks, where a 
group of autonomous agents has to collect information 
about a process by choosing maximally informative sam- 
ples [1,2], to formation control of autonomous vehicles 
(e.g. unmanned aerial vehicles) [3,4]. In these contexts 
it is important to consider the case where the ambient 
space is the three-dimensional Euclidean space. 

In the present paper we consider a model of identical par- 
ticles, each with steering control, moving at unit speed 
in three-dimensional Euclidean space. We address the 
problem of designing feedback control laws to stabilize 
relative equilibria in the presence of limited communica- 
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tion among the agents. These equilibria are character- 
ized by motion patterns where the relative orientations 
and relative positions among the particles are constant 
[3] . The equilibria correspond to motion of all particles 
cither 1) along parallel lines in the same direction, 2) 
around circles with common axis of rotation or 3) on 
helices with common pitch and common axis of rota- 
tion. Therefore, our stabilization problem is a consensus 
problem where particles need to come to consensus on 
the direction, axis and pitch of their collective motion. 
These motion patterns are motivated by applications to 
vehicle groups, e.g., they provide natural and useful pos- 
sibilities for collecting rich data in three-dimensional en- 
vironments. Motion patterns studied in the present pa- 
per are also motivated by the collective motion of certain 
animal groups [5] . 



As described by Justh and Krishnaprasad [3], the model 
for a steered, unit-speed particle can be described as a 
control system on the Lie group of rigid motions, SE(3). 
The control lives in a subspace of the Lie algebra se(3) 
and provides a gyroscopic force that changes the par- 
ticle's orientation (direction of motion). Accordingly, a 
group of N steered, unit-speed particles can be modeled 
as a control system on the direct product of N copies 
of SE(3). We choose feedback control laws that depend 
only on relative positions and relative orientations of 
particles; therefore, the control preserves the SE(3) sym- 
metry of the formation. An important consequence is 
that no external reference is required. 



Geometry plays a central role in the investigation of 
the present paper and the roots of the geometric ap- 
proach can be traced back to the influential work of 
Roger Brockett in the area of geometric control [6] . Of 
particular importance here, is the study of control sys- 
tems on Lie groups that was formalized in Brockett's 
seminal work in the 1970's [7-9]. Brockett showed that 
system-theoretic questions, such as controllability, ob- 
servability and realization theory, for a control system 
on a Lie group can be reduced to questions on the corre- 
sponding Lie algebra. This work has had and continues 
to have enormous influence, with applications ranging 
from switched electrical networks [10] to nonholonomic 
systems [11] to control of quantum mechanical systems 
[12]. 

In the present paper, the geometric approach and cen- 
tral thesis for control systems on Lie groups are used to 
reduce the coordination problem on the Lie group to a 
consensus problem on the corresponding Lie algebra. In 
particular, stabilizing particle group dynamics on SE(3) 
is reduced to solving a consensus problem on the space 
of twists, se(3). 

As a first step we derive stabilizing control laws in the 
presence of all-to-all communication among the agents 
(i.e. when each agent can communicate with all other 
agents at each time instant). All-to-all communication 
is an assumption that is often unrealistic in multi-agent 
systems. In particular, in a network of moving agents, 
some of the existing communication links can fail and 
new links can appear when agents leave and enter an 
effective range of detection of other agents. To extend 
the all-to-all feedback design to the situation of limited 
communication, we use the approach recently proposed 
in [13,14], see also [15] and [16] for related work. 

This approach suggests to replace the average quan- 
tities, often required in a collective optimization algo- 
rithm, by local variables obeying a consensus dynamics 
constrained to the communication topology. The idea 
has been successfully applied to the problem of synchro- 
nization and balancing in phase models in the limited 
communication case [14] and to the design of planar col- 
lective motions [17]. 

The approach leads to dynamic control laws that include 
a consensus variable that is passed to communicating 
particles. The additional exchange of information is re- 
warded by an increased robustness with respect to com- 
munication failures and therefore is applicable to limited 
and time- varying communication scenarios. 

On the basis of these results we design control laws that 
globally stabilize collective motion patterns under mild 
assumptions on the communication topology. 

The present paper generalizes, to three-dimensional 
space, earlier work in the plane [18,17]. Previous re- 



sults in SE(3) have been presented in [3] and in [19,20]. 
Similar approaches, applied to rigid body attitude syn- 
chronization, have been presented in [21,22]. 

The rest of the paper is organized as follows. In Section 
2 we define the model for a group of steered particles 
moving in three-dimensional Euclidean space with uni- 
tary speed. In Section 3 we review some concepts from 
the theory of screws and we present a general methodol- 
ogy to stabilize relative equilibria on SE(3). In Section 

4 we derive control laws that stabilize relative equilibria 
in the presence of all-to-all communication. In Section 

5 we summarize some graph theoretic notions and some 
results on the consensus problem in Euclidean space. In 
Section 6, we design dynamic control laws that stabilize 
relative equilibria in the presence of limited communica- 
tion. Finally, in Section 7, a brief discussion about pos- 
sible applications in underwater robotics is presented. 

For the reader's convenience the proofs of the theorems 
are reported in the appendix. 

2 A model of steered particles in SE(3) 

We consider a model of N identical particles (with uni- 
tary mass) moving in three-dimensional Euclidean space 
at unit speed: 



r k 

Xk 



x k 



1,2,..., A, 



(1) 



where r k € K 3 denotes the position of particle k, x k 
is the unit-norm velocity vector and uf, £ M 3 is a con- 
trol vector. Model (1) characterizes particle dynamics 
with forcing only in the directions normal to velocity, 
i.e. r k = u% x ffe. An alternative to (1) is to provide 
each particle with an orthonormal frame and to write 
the system dynamics in a curve framing setting [3] : 



r k = x k 

x k = y k q k + z k h k 
y k = -x k q k + z k w k 
z k = -x k h k - y k w k , 



(2) 



1,...,A, 



where (x k , y kl z k ) is a right handed orthonormal frame 
associated to particle k (in particular x k e 5 2 is the 
(unit) velocity vector). The scalars q k , h k represent the 
curvature controls of the kth particle. The scalar w k adds 
a further degree of freedom allowing rotations about the 
axis x k . In vector notation we define 



u k = 



w k 
-hk 
q k 



(3) 



2 



The advantage of using model (2) instead of model (1) 
relies on its group structure. Model (2) indeed defines a 
control system on the Lie group SE(3) and the dynamics 
(2) can be expressed in terms of the group variables q k e 
SE{3): 

9k = 9kik, k = l,...,N, (4) 

where £ k e se(3) is an clement of the Lie algebra of 
SE(3), the tangent space to SE(3) at the identity. From 
(2) we obtain 



9k 



Rk r k 
1 



Rk = [x k ,y k ,z k ] e 50(3), 



and 



where 



tk 



u k ei 




-Qk 

qk 

h k w k 



(5) 



-Wk 




is a skew-symmetric matrix that represents an element of 
so(3), the Lie algebra of SO{3) . We denote by (ei, e 2 , e 3 ) 
the standard orthonormal basis for M 3 . 

When only the orientations of the particles are taken 
into account, the reduced dynamics of (4) are 

R k = R k ii k , k=l,...,N (6) 

and the system evolves on the Lie group SO(3). 

It is worth noting that the following relation exists be- 
tween the control vector u k in (1) and the vector u k in 
(3): 

u a k = R k u k . (7) 

Therefore u k can be interpreted as the control vector u k 
expressed in the spatial reference frame 1 . 

If the curvature controls in model (2) are feedback func- 
tions of shape quantities (i.e. relative frame orientations 
and relative positions) , the closed- loop vector field is in- 
variant under an action of the symmetry group SE{3). 
The resulting closed-loop dynamics evolve in a quotient 
manifold called shape space and the equilibria of the re- 
duced dynamics are called relative equilibria. To formally 
introduce the shape variable associated to two particles 
k and j we define 



9kj 



9 k 1 9j 



1 We adopt the word spatial to mean "relative to a fixed 
(inertial) coordinate frame" . 



which, in the case of dynamics evolving on SE(3), par- 
ticularize to 



9kj = 



Rkj 




where R k j = R k Rj and r k k = R k (rj — r k ). As pointed 
out previously, our control laws will be restricted to de- 
pend on shape variables only. Therefore the (static and 
dynamic) control laws will assume the form 



and 



u k = rit{K kj ,V k jk , lk ) 



,N}, 



% = p k {Ti kj ,V k jkllk ), 

respectively, where lZ k j = {R k j,j = 1,2, 
T>j k — {r k j, j = 1,2,..., N} and j k are additional con- 
sensus variables. As we will see in the following, dynamic 
control laws will be used several times in the paper. In 
particular it will turn out that (in general) to stabilize 
relative equilibria in a decentralized framework a static 
control law is not sufficient. Furthermore, as pointed 
out in earlier works [14,13,17], dynamic control laws are 
required when a limited communication setting is taken 
into account (see Section 6). 

Relative equilibria of the model (2) have been charac- 
terized in [3]. The equilibria, depicted in Figure 1, are of 
three types: 

i) Parallel motion: all particles move in the same direc- 
tion with arbitrary relative positions; 

ii) Circular motion: all particles draw circles with the 
same radius, in planes orthogonal to the same axis of ro- 
tation; 

iii) Helical motion: all particles draw circular helices with 
the same radius, pitch, axis and axial direction of mo- 
tion. 

In the following section we will show how to character- 
ize the relative equilibria by using screw theory. This 
approach will be particularly useful in Section 4 when 
the problem of stabilizing the relative equilibria will be 
addressed. 



3 Stabilization of relative equilibria as a consen- 
sus problem 

In terms of screw theory [23], an clement of se(3) is 
called a twist. The motion produced by a constant twist 
is called a screw motion. The operator denoted by V ex- 
tracts the 6-dimensional vector which parameterizes a 
twist: (5) yields 



£ fc = 







V 






ei 




ei 










_u k _ 
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(a) 



(b) 



(c) 



Fig. 1. The three types of relative equilibria: (a) parallel, (b) 
circular and (c) helical. 

The inverse operator, A, expresses the twist in homoge- 
neous coordinates starting from a vector form: (5) yields 



To give a geometric interpretation to (8) we compute 
the relative screw coordinates (expressed in the spatial 
frame) and we obtain an (instantaneous) pitch 



Pk 



T 

ej u k 

IKII 2 



an (instantaneous) axis 



1" 

l k 



uy x Xk + Vk * ul + Xu%, if u k + 



+ \x k , 



if u k = 



and (instantaneous) magnitude 





A 




ei 




u k ei 






0_ 



A constant twist £ = [vq , o?q ] € K 6 defines the screw 

motion g(0)e^o' on SE(3) [23], where g(0) denotes the 
initial condition. When Wo ^ this motion yields a fi- 
nal configuration that corresponds to a rotation by the 
amount 6 — ||u?o|| about an axis Z, followed by transla- 
tion by an amount po \ \u>o\ \ parallel to the axis /. When 
Wo = the corresponding screw motion consists of a 
pure translation along the axis Xv of the screw by a 
distance Mo = ||uo||- The relations among the screw 
(lo,Po, Mq) and twist £ are the following [23]: 



Po 



la = 



Wq Vq 

00, 

WnXUn 



if w ^ 
if Wo = 
Awo, if wo 7^ 
if w = 
||w ||, ifwo^O 
IKII, ifw o = 



ll«o|| J 1 
+ \v , 



where A 6 



In the context of model (4), the twist (in body coordi- 
nates) is given by £ k — [ej , uJ] T . To map £ fc into a spa- 
tial reference frame, one uses the adjoint transformation 
associated with g k 



Rk r k R k 
R k 



M k = 



\u k \\, if u k ^ 



1, 



if u k = 0. 



Therefore, constant control vectors u k , k — 1, 2, . . . , N, 
define screw motions (corresponding to helical, circular 
or straight motions). 

Now we are ready to geometrically characterize the rel- 
ative equilibria of (4). Consider two particles and their 
respective group variables g k and Qj. The dynamics for 
g k j = g k 1 gj (the shape variable) are given (see [3]) by 



9k] = -9k 1 9k9k l 9j+9k 1 9jtj 

= -£k9kj + gkjij 
= 9kj{kj -Ad g -i£ k ). 



(9) 



Equation (9) implies that a relative equilibrium of (4) is 
reached when the twists (expressed into a spacial refer- 
ence frame) are equal for all the particles, i.e. £ k = £q 
for k = 1, . . . , iV, £o arbitrary. To see it, it is sufficient 
to equate the last term in (9) with zero and to apply the 
adjoint transformation Ad gj obtaining 



Ad fl .^- 



(10) 



which yields 



Since the screw coordinates associated to the common 
value £q provide a geometrical description of the mo- 
tion, the relative equilibria are characterized by a pitch, 
an axis and a magnitude uniquely determined by . We 
summarize the above discussion in the following Propo- 
sition. Let ljy = (1, . • • , 1) T € R N . 



Ck = Ad gk £ k 



x k + r k x R k u k 
RkU k 



x k + r k x u% 



(8) 



Proposition 1 The following statements are equiva- 
lent: 

i) System (2) is at a relative equilibrium. 

ii) The twists ^ defined by (8) are equal for k = 



4 



1,2, ... ,N, i.e. the following algebraic condition is sat- 
isfied 

IIC = o, 

wherefl= (I N -jfl N lJf)^I 6 and$ a = col(£f, . . . , 

a 

Proposition 1 reduces the problem of stabilizing a rel- 
ative equilibrium on SE(3) to a consensus problem on 
twists. 

In the rest of the paper, we denote by £ the set of so- 
lutions of (2) with consensus on the rotation vector, i.e. 
ui%=w a jt k,j = 1,2,. .. ,N : 



we obtain 



x k - u k Jr k 
u k 



k = l,...,N. 



(12) 



When u k ,k = 1, . . . , N, are constant, only two types of 
motion are possible for (11), straight motion (u k = 0) 
and circular motion (u k = ojq). When (12) are equal 
and constant for all the particles the resulting motion 
is characterized by a parallel formation (u k = 0) and 
a circular formation about the same point (u k ^ and 
constant). Stabilizing control laws are derived in [18,17]. 



£ = {g k £ SE(3), k = 1, . . . , N : g k = g k (0)e^, 
£ k = col(ei, Rlu>%), u% = = 1, 2, . . . , N, 
ff fc (0) G SE(3)} 

and we denote by E the subset of £ corresponding to 
relative equilibria. By Prop. 1, this set is characterized 
as 

E^ {g k €SE{3),k=l,...,N -.geE, 
v% = v a j , j = l,2,...,N}. 



Likewise we will denote by S(<*>o) the subset of S where 
u> k = u>o, k = 1, 2, . . . , N, for some fixed u>q £ M 3 and 
by E((jj ) the subset of E with a fixed rotation vector 

U)Q. 

Remark 1 The discussion above particularizes to 
SE{2). Consider the (planar) model 



r k = x k 
x k = u k y k 

v k = -u k x k . 



(ii) 



for k 



. . , N. In the Lie group SE(2), we obtain 



9k = 



R k r k 




u k ei 








1 






for k = 1, . . . , N, where 

R k = [x k ,y k ]£SO(2), 



u k 



-Uk 
u k 



Ju k , 



J 



-1 

1 



andei = [1,0] T . In this case the twist is £ k = [e{,u k \ T £ 
R 3 . By mapping the twist coordinates to a spatial frame 



Stabilization of relative equilibria in the pres- 
ence of all-to-all communication 



From (8), when a particle k applies the constant control 
u k = u> k , the (constant) twist expressed in the spatial 
reference frame is 



Motivated by Proposition 
punov function is 



x k + r k x R k u) k 




~v a k ~ 


R k v k 







(13) 



1 a natural candidate Lya- 



1 2 1 N 

v(?) = - fie =^m-c 



(14) 



fe=i 



where the subscript "av" is used to denote average quan- 
tities, i.e. 



1 N 
P a = — \ " £ a 

^av lu / j Sfe- 



N 
k=i 

This is the approach pursued in [18] for collective motion 
in SE(2). 

Unfortunately, from (13), it is evident that the first com- 
ponent v^, is not linear in the state variables. As a conse- 
quence v^ v ^ x av + r av x a;° v and the approach followed 
in [18] does not yield shape control laws. To understand 
how to overcome this obstacle we first stabilize the mo- 
tion about an axis of rotation with direction that is fixed. 
In Section 4.3 we relax the design by replacing, in the 
control laws, the fixed direction of the axis of rotation 
with (local) consensus variables, thereby obtaining sta- 
bilizing shape control laws. A simplification occurs when 
the desired relative equilibrium corresponds to parallel 
formations. For this relative equilibrium the twists re- 
duce to the velocity vectors and therefore a simplified 
consensus problem may be addressed. In the next sec- 
tion we address this simpler case, while the general case 
is addressed in Section 4.2 and in Section 4.3. 
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4-1 Stabilization of parallel formations 



First observe that when the particles follow straight tra- 
jectories (13) reduces to 



x k 




and the Lyapunov function (14) reduces to 



V(x) 



N 
~2 



1 - \\x a 



(15) 



The parameter ||x av || is a measure of synchrony of 
the velocity vectors x k , k = 1, 2, . . . , N. In the model 
(2), 1 1 £E av 1 1 is maximal when the velocity vectors are 
all aligned (synchronization) leading to parallel forma- 
tions. It is minimal when the velocities balance to result 
in a vanishing centroid, leading to collective motion 
around a fixed center of mass. Synchronization (balanc- 
ing) is therefore achieved by minimizing (maximizing) 
the potential (15). The time derivative of (15) along the 
solutions of (6) is 



N 



(16) 



where < •, • > denotes the scalar product. 

The control law 

u k = Rl(x k x £c av ), k = l,...,N, (17) 

ensures that (15) is non-increasing. 

The following result provides a characterization of the 

dynamics of model (2) with the control law (17). 




(a) (b) 

Fig. 2. Parallel and balanced formations. 

Remark 3 It is worth noting that the feedback control 
(17) does not depend on the relative orientation of the 
frames but only on the relative orientations of the velocity 
vectors. Therefore, each particle compares only relative 
velocity vectors with respect to its own reference frame, 
in order to implement control law (17). 

4- 2 Stabilization of screw relative equilibria: prelimi- 
nary design 

Let u>o € E 3 be a fixed constant vector expressed in the 
spacial reference frame. Observe that under the constant 
control law u k — R^ljo, a relative equilibrium is reached 
when the vectors in (13) are equal for all the particles. 

Up to an additive constant the Lyapunov function (14) 
becomes 



S(v a ,u ) 



1 N 

-Y 

2 ^ 

k=l 



(18) 



where v% = Xk + r k X u>o and v a = col(t>°, . . . , The 
time derivative is 



Theorem 1 Consider the model (2) with the control law 
(17). The closed-loop vector field is invariant under an 
action of the group SE(3). Every solution exists for all 
t > and asymptotically converges to S(0). Further- 
more, the set E '(0) of parallel motions is asymptotically 
stable in the shape space and every other positive limit 
set is unstable. □ 

As a consequence of Theorem 1 , we obtain that the con- 
trol law (17) stabilizes parallel formations (see Fig. 2a). 

Remark 2 When the sign is reversed in (17), only the 
set of balanced states (i.e. those states such that x av is 
zero) is asymptotically stable and every other equilibrium 
is unstable. This leads to configurations where the center 
of mass of the particles is a fixed point (see Fig. 2b). The 
stabilization of the center of mass to a fixed point does 
not lead in general to a relative equilibrium and therefore 
is not of interest in the present paper. 



N N 

S =V < v%-vt„ vi >=V < vi-v«x k +x k xu> > 



fe=l 



fc=l 



The control law 

u k = Rl (u>o + [(rk - r av ) x - x av ] x x k ) 
for k = 1, . . . , N, results in a non-increasing S 



S 



N 

Ei 

k=l 



< o. 



(19) 



(20) 



where Hx k = I — x k x\ is the projection matrix on the 
orthogonal complement of the subspace spanned by x k . 
Note that the dynamics with the control law (19) are 

v% = -n Xk (v a k - < v ) , k=l,...,N. (21) 
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The convergence properties of the resulting closed-loop 
system are characterized in the following theorem: 



4-3 Dynamic shape control laws for stabilization of 
screw formations 



Theorem 2 Consider model (2) with the control law 
(19). The closed-loop vector field is invariant under an 
action of the translation group R 3 . Every solution exists 
for allt > and asymptotically converges to S(u>o)- Fur- 
thermore, the set E{ujq) of relative equilibria with rota- 
tion vector ljq is asymptotically stable in shape space and 
every other positive limit set is unstable. □ 



In steady state, the particle motion is characterized by 
a constant (consensus) twist £ = [vq , Wq] t . The corre- 
sponding screw parameters are a pitch p =< v ,uj > 
I ||wo|| 2 , an axis l = {v x u> / ||^o|| 2 + Au; , A E R} 
and a magnitude M = | |u>o| |- Therefore the control law 
(19) stabilizes all the particles to a relative equilibrium 
whose pitch depends on the initial conditions of the par- 
ticles. To reduce the dimension of the equilibrium set we 
combine the Lyapunov function (18) with the potential 



Because the control laws (19) and (23) depend on the 
vector cj , the resulting closed-loop vector field is not 
invariant under an action of the rotation group SO (3) 
on the rotation vaiables. An important consequence is 
that additional information is required besides the rel- 
ative configurations among the particles. To overcome 
this obstacle we propose a consensus approach to reach 
an agreement about the direction of the axis of rotation. 
We provide each particle with a consensus variable u: k , 
and we denote by u>% — R k oJ k the same quantity ex- 
pressed in a (common) spatial reference frame. The po- 
tential 



E/(0 = y£lK-"av 



N 



(25) 



k=i 



where u> a is the stacking vector of the vectors u>1 . . . , ut^, 
decreases along the gradient dynamics 



N ( < a; ,a; av > 
ll«o|| 



ae [0,1), 



(22) 

that is minimum when all the particles follow a trajec- 
tory with the same pitch p = a. This leads to the con- 
trol law 



R I 



w + 



(rk - fav) X LV Q -X a 



+ 



( <<jJo,X.^> _ \ U)g 

\ ll«o|| "J IIWoll 



X x k 



(23) 



for k = 1, . . . , N, which guarantees that Q + S is non- 
increasing along the solutions. 

Theorem 3 Consider model (2) with the control law 
(23). The closed-loop vector field is invariant under an 
action of the translation group R 3 on position variables 
rk - Every solution exists for allt > and asymptotically 
converges to E(u>o). Furthermore, the set of relative equi- 
libria with rotation vector u>q and pitch a is asymptoti- 
cally stable in shape space and every other positive limit 
set is unstable. □ 

The control law (23) stabilizes all the particles to a rela- 
tive equilibrium whose magnitude and pitch are fixed by 
the design parameters a and ||u>o|| - In particular, acting 
on a it is possible to separate circular relative equilibria 
(a = 0) from helical relative equilibria (a e (0, 1)). 

It is worth noting that when lj is set to zero the control 
law (19) reduces to 



u k = Rl (x k x x a 



k=l,...,N. (24) 



This control law stabilizes parallel formations and has 
been studied in Section 4.1. 



U)i 



N 



,N. 



(26) 



Expressing (26) in the body reference frame we obtain 



U^LJk 



N 



Wfc, 



(27) 



for k = 1, . . . , N, and we observe that the dynamics (27) 
are invariant under an action of the symmetry group 
50(3). It turns out that the dynamic control law result- 
ing from the coupling between the consensus dynamics 
(27) with the control law (19) leads to the shape control 
law 



U k = LJ k + [Rk ( r k - Tav) X Wfc - R\ X av ] X B\, 



(28) 



for k = 1, . . . , N. In the sequel, we denote by 

Co; = M, k = 1, 2, . . . , N : u a k = = 1, 2, . . . , N} 

the set of consensus states for the controller variables 
u%,k=l,2,...,N 2 . 

Theorem 4 Consider model (2) with the dynamic con- 
trol law (28) The closed-loop vector field is invariant 
under an action of the group SE(3) on the state vari- 
ables (r k ,R k ) and an action of the group M 3 on the con- 
troller variables uj^. Every solution exists for all t > 0, 
and asymptotically converges to S x . Furthermore, 



2 From here on we will denote with Crj the set of consensus 
states for the variables r)\ G E 3 , k = l,2,...,N. 
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Fig. 3. Relative equilibria stabilized with control law (28) 



E x C(jj is asymptotically stable in the (extended) shape 
space and every other positive limit set is unstable. □ 

Remark 4 The control law (28) is the "dynamic" ver- 
sion of the control law ( 19) and therefore stabilizes all the 
particles to a relative equilibrium with arbitrary pitch. To 
assign to the pitch a desired value it is sufficient to derive 
the dynamic version of (23) where consensus dynamics 
determine a common ujq. 

In Fig. 3 are depicted circular and helical formations 
stabilized by means of the control law (28). 

4-4 Stabilization to a specific screw motion: symmetry 
breaking 

In several applications like sensor networks or formation 
control, it can be of particular interest to stabilize the 
motion to a desired screw. To do so, we must break the 
symmetry of the control laws presented in the preceding 
sections. From Section 3 we know that a screw is encoded 
by a constant six dimensional vector £ = [vq , Uq] t . 

Consider a virtual particle with dynamics 

*° = X ° (29) 

X = LJq X Xq. 

The particle describes a screw motion characterized by a 
magnitude Afo = ||^o||, an axis = Trk" tL 'o x (i>o x w o)+ 
Au: and a pitch p = < x ,u> >, where A £ M and 



Vq = Xq + ro x u; - In the case in which all the particles 
receive information from the virtual particle, the control 
law (19) can be modified as 

U k = Rl [ Wo + K - *av) x Xk] ■ (30) 

for k = 1, 2, . . . ,N, where v a &v = ^ Y^ =Q 

Proposition 2 Consider the closed-loop system given 
by (2) and the control law (30). Every solution exists 




Fig. 4. On the top: Helical formation stabilized with the con- 
trol law (30) . The parameters of the helix are set to po = 0.5, 
lj = [1, 1, 1] T and l = [1, -1, 0] T + Xlj . On the bottom: 
Helical formations stabilized with the control law (32). Each 
subgroup converges to a different screw defined by a differ- 
ent axis and a different pitch. 

for all t > and asymptotically converges to T,(u>o). 
Furthermore, the set of relative equilibria with rotation 
vector uiq, pitch po and axis Iq is asymptotically stable 
and every other positive limit set is unstable. □ 

This approach is well suited to stabilize subgroups of 
particles to different screw formations. To this end is 
sufficient to define a virtual particle for each subgroup 
and to fix the parameters of the desired screw motions. 
Consider M subgroups of particles B\ . . . , Bm- For sim- 
plicity let the cardinality of each group be n. Define n 
virtual particles obeying the following dynamics: 

1:1 , ( 3i ) 

x o — w o x x o- 

for i = 1, . . . ,M. Define = ^ (E^b, v " + <) . 
where v l = x l Q + r' l x uj z and t)° = Xj + r$ x wj,, j e B L 
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(where, with a little abuse of notation, we dropped the 
apex a in the average velocity) . 

The following control law generalizes (30): 

u k = R T k [u>* + {v% - vl) xx k ], keB, (32) 

for i = 1, . . . ,M. 

As a direct corollary of Proposition 2 the control law (32) 
stabilizes the particles in each group B i7 i — 1, . . . , M to 

a screw motion defined by Co = [ v o ! w o T ] T - In Fig. 4 
different motion patterns, obtained by adopting control 
laws (30) and (32), are displayed. 

All the control laws presented until this point stabilize 
the relative equilibria of (2) under the assumption of all- 
to-all communication among the particles. In Section 6 
we relax this requirement by substituting the quantities 
in (28) that require global information with consensus 
variables obeying consensus dynamics. 

Before detailing the approach, in the following section 
we review some concepts about consensus in Euclidean 
space and we summarize some graph theoretic notions 
that are needed to address the problem in a limited com- 
munication setting. 

5 Communication graphs and consensus dy- 
namics in Euclidean space 

In this section we review some recent results on the con- 
sensus problem. Consider a group of agents with limited 
communication capabilities; in this context it is useful 
to describe the communication topology by using the 
notion of communication graph. 

Let G = (V,£,A) be a weighted digraph (directed 
graph) where V = {vi,. . . ,Vn} is the set of nodes, 
£ C V x V is the set of edges, and A is a weighted adja- 
cency matrix with nonnegative elements a k j ■ We assume 
that there are no self-cycles i.e. a k k = 0, k = 1, 2, . . . , N. 

The graph Laplacian L associated to the graph G is 
defined as 

L kj = \ 

{-a k j, j^k. 

The fc-th row of L is defined by L k . The in-degree (re- 
spectively out-degree) of node v k is defined as d\ n — 

Z)jLi a kj (respectively d° k ut = Ylf=i a jk)- The digraph 
G is said to be balanced if the in-degree and the out- 
degree of each node are equal, that is, 

^2 a kj = ^2 a 3k, k=l,2,...,N. 

3 3 



If the communication topology is time varying, it 
can be described by the time-varying graph G(t) = 
(V,£(t),A(t)), where A(t) is piece wise continuous 
and bounded and a k j(t) G {0} U [»J,7],Vfc,j, for some 
finite scalars < r\ < 7 and for all i > 0. The 
set of neighbors of node v k at time t is denoted by 
-A/fc(i) — { v j € V : a k j(t) > n}. We recall two definitions 
that characterize the concept of uniform connectivity 
for time- varying graphs. 

Definition 1 Consider a graph G{t) = (V, £(t), A(t)). 
A node v k is said to be connected to node Vj (vj ^ 
in the interval I = [t a , tb] if there is a path from v k to Vj 
which respects the orientation of the edges for the directed 
graph (Af 1 U teI £(t),j I A(T)dT). 

Definition 2 G(t) is said to be uniformly connected if 
there exists a time horizon T > and an index k such 
that for all t all the nodes Vj (j ^ k) are connected to 
node k across [t, t + T]. 

Consider a group of N agents with state p k € P, where 
P is an Euclidean space. The communication between 
the A^-agents is defined by the graph G: each agent can 
sense only the neighboring agents, i.e. agent j receives 
information from agent i if and only if i S Afj (t) . 

Consider the continuous dynamics 

N 

i>k = Y. ak ^P3-Pk), k = l,2,...,N. (33) 

j=i 

Using the Laplacian definition, (33) can be equivalently 
expressed as 

p=-L(t)p, (34) 

where L = L ® I3 and p = (pj , . . . ,pJj) T . Algorithm 
(34) has been widely studied in the literature and asymp- 
totic convergence to a consensus value holds under mild 
assumptions on the communication topology. The fol- 
lowing theorem summarizes some of the main results in 
[24], [25] and [26]. 

Theorem 5 Let P be a finite- dimensional Euclidean 
space. Let G(t) be a uniformly connected digraph and L(t) 
the corresponding Laplacian matrix bounded and piece- 
wise continuous in time. The solutions of (.34) asymp- 
totically converge to a consensus value /31 for some [3 € 
P. Furthermore if G(t) is balanced for all t, then j3 = 

hT^iPM- □ 

A general proof for Theorem 5 is based on the property 
that the convex hull of vectors p k e W is non expand- 
ing along the solutions. For this reason, the assumption 
that W is an Euclidean space is essential (see e.g. [25]). 
Under the additional balancing assumption on G(t), it 
follows that l T L(t) = 0, which implies that the average 
Tf J2jexPj ^ s an mvar i an t quantity along the solutions. 
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6 Stabilization of relative equilibria in the pres- 
ence of limited communication 

Consider the control laws (17) and (28). By following 
the approach presented in [14] we substitute the quan- 
tities that require all-to-all communication, i.e. r av and 
x av , by local consensus variables. This leads to a gener- 
alization of the control laws (17) and (28) to uniformly 
connected communication graphs. We consider first the 
problem of stabilizing a parallel formation. 

6.1 Stabilization of parallel formations with limited 
communication 

We replace the control law (17) with the local control 
law 

u k = Rl(x k xb a k ), k=l,...,N, (35) 
where b\ is a consensus variable obeying the consensus 
dynamics 

N 

i> a k = -J2 L V b j> k = l,...,N, (36) 
i=i 

with arbitrary initial conditions 6^(0), k = 1, . . . , N. Be- 
fore detailing the convergence analysis we express (35) 
and (36) in shape coordinates by moving to a local ref- 
erence frame. Then (35) rewrites as 

u k = ( ei xb k ), k = l,...,N, (37) 

and (36) as 

N 

b k = ulb k - ^2 LkjRkRjbj, (38) 

where 6 fe (0) = i^(0)6£(0), k = 1, . . . , N. The following 
result characterizes the convergence properties of the 
resulting closed-loop system. 

Theorem 6 Consider model (2) with the control law 
(37), (38). The closed-loop vector field is invariant un- 
der an action of the group SE(S) on the state variables 
(r k ,R k ) and an action of the group R 3 on the consen- 
sus variables b%. Suppose that the communication graph 
G(t) is uniformly connected and that L(t) is bounded and 
piecewise continuous. Then every solution exists for all 
t > and asymptotically converge to S(0) x C^. Fur- 
thermore, the set E(0) x C^ is asymptotically stable in 
the (extended) shape space and every other positive limit 
set is unstable. □ 

6.2 Stabilization of screw formations in the presence of 
limited communication 

We finally address the problem of stabilizing screw rela- 
tive equilibria in the presence of limited communication. 



The procedure to generalize the control law (28) is the 
same as outlined in the previous section and therefore is 
omitted. Consider the dynamic control law 

u k =uJ k + (u> k x c fe - b k ) x ei 

-T v^.V T iz>T d 

UJ k -U k LD k - 2^=1 L kjR k RjUj 

b k =ulb k - J2j=i L kjR k Rjbj 

c k =ii T k c k - e x - J2f=i L k 3 RlR 3 Cj -Ejli L k 3 Rlrj, 

(39) 

for k = 1,...,N, and define uj k = R k w k , b^ = 
R k b k , c k = R k c k + r k . 

Theorem 7 Consider model (2) with the control law 
(39). The closed-loop vector field is invariant under an 
action of the group SE(3) on the state variables (r k , R k ) 
and an action of the group M 3 x R 3 x R 3 on the con- 
sensus variables (u}f.,b%,c k l ). Suppose that the commu- 
nication graph G(t) is uniformly connected and that L(t) 
is bounded and piecewise continuous. Then every solu- 
tion exists for all t > and asymptotically converge to 
S x Cuj xCjjXCc - Furthermore, the set Ex C^j xC^xC c 
is asymptotically stable in the ( extended) shape space and 
every other positive limit set is unstable. 

It is important to note that the control law (39) does 
not require all-to-all communication among the parti- 
cles. In particular the convergence properties of Theorem 
4 are here recovered in the presence of limited commu- 
nication, for directed, time- varying (but uniformly con- 
nected) communication topologies. Furthermore, follow- 
ing the approach proposed in [17] , it is possible to extend 
the symmetry-breaking approach presented in Section 
4.4 to the limited communication scenario. This can be 
done redefining the graph Laplacian by adding a directed 
link connecting every particle to a virtual particle. The 
uniformly connectedness assumption on the new graph 
guarantees convergence to the desired screw motion. 

Due to space constraints we do not report here the de- 
tails, the interested reader is refereed to [17] where the 
planar case is considered. 

7 Discussion on possible applications 

In this paper models of point-mass particles at con- 
stant speed are considered. From the engineering and 
application-oriented prospective, they are a strong sim- 
plification of the dynamic models that can be used in 
"real world" applications. To introduce more sophisti- 
cated models in our scheme, a reasonable solution is to 
decouple the collective design problem (that we have ad- 
dressed in the present paper) with a trajectory tracking 
problem where the details about the system dynamics 
are taken in account. This means that each vehicle is 
provided with a trajectory "planner" that designs the 
required trajectory by exchanging information with the 
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other vehicles. A second module, namely a tracking con- 
troller, must be designed to ensure that the discrepancy 
between the actual trajectory and the designed one is 
minimized. This module incorporates the details about 
the dynamics of the system and is completely decoupled 
from the other vehicles. 

A particularly interesting application is the collection of 
sensor data with underwater gliders. Underwater gliders 
are autonomous vehicles that rely on changes in vehicle 
buoyancy and internal mass redistribution for regulating 
their motion. They do not carry thrusters or propellers 
and have limited external moving control surfaces. For 
these vehicles only a subset of the relative equilibria may 
be realized, and they correspond to motion (at constant 
speed) along circular helices and straight lines [27]. In 
particular, for equilibrium motion along a circular helix, 
the axis of the helix must be aligned with the direction 
of gravity. This suggests to apply the control laws pre- 
sented in the present paper, fixing the direction of the 
rotation axis to Wo = — c [0, 0, 1] T , where c is a constant 
positive scalar, to plan the desired trajectories. The pa- 
rameters of the desired helical motion, and consequently 
of the control law of the planner, can be chosen on the 
basis of energy efficiency criteria (which depend on the 
glider's parameters) and to concentrate the data collec- 
tion at the desired location. The problem of designing a 
trajectory tracking controller for underwater gliders has 
been addressed in [27] and is beyond the scope of the 
present work. 



8 Conclusions 

We propose a methodology to stabilize relative equilib- 
ria in a model of identical, steered particles moving in 
three-dimensional Euclidean space. Observing that the 
relative equilibria can be characterized by suitable in- 
variant quantities, we formulate the stabilization prob- 
lem as a consensus problem. The formulation leads to a 
natural choice for the Lyapunov functions. Dynamic con- 
trol laws are derived to stabilize relative equilibria in the 
presence of all-to-all communication and arc generalized 
to deal with unidirectional and time-varying communi- 
cation topologies. It is of interest (in particular from the 
application point of view) to study in the future how to 
reduce the dimension of the equilibrium set by breaking 
the symmetry of the proposed control laws. 

Appendix 



A Proof of Theorem 1 

Since the control law (17) is independent from the rela- 
tive spacing of the particles, we can limit our analysis to 



the reduced dynamics (6). Plugging (17) into (16) yields 

N 

V=-J2\\ X k X Zav|| 2 < 0. 
k=l 

V is positive definite (in the reduced shape space) and 
non increasing. By the La Salle invariance principle, the 
solutions of (6) converge to the largest invariance set 
where 

x k x x av = 0, k=l,...,N. (A.l) 

This set is contained in S(0). The points where x av = 0, 
are global maxima of V. As a consequence this set is un- 
stable. From (A.l), equilibria where x av ^ are charac- 
terized by the vectors x k , k = 1 , . . . , N, all parallel to the 
constant vector with x av . Note that this configuration 
involves N— M velocity vectors aligned to x av and M ve- 
locity vectors anti-aligned with x av , where < M < ^ . 

At those points, ||cc av || = 1 - ^ > -L. When M = we 
recover the set of synchronized states (global minima of 
V) which is stable. Every other value of M corresponds 
to a saddle point (isolated in the shape space) and is 
therefore unstable. To see this we express x k and x av in 
spherical coordinates, 

x av — ||a; av || [cos $ sin 6, sin <!> sin 6, cos 6] T , 

x k = [cos<p k s'm9 k ,smcf) k sm9 k ,cos9 k } T , 

where 9 k ,Q € [0,7r] and <j) k7 & € [0,27r). By expressing 

V with respect to spherical coordinates we obtain 

N 1 N 

V = — (l - — | |aj BV || ^ ( sin sin 0j cos($ - fo) 

3 = 1 

+ cos6cos#j)^. 

(A.2) 

The critical points are characterized by 

x k = [cos $ sin 6, sin $ sin 6, cos 6] T , k = M+l, ...,N, 

and 

x k = [cos(<f> + 7r) sin(7r — 0), sin(<f> + n) sm(n — 0), 
cos(7r-6)] T , k = l,...,M. 



The second derivative of V (with respect to 0j) is 

d 2 V 1 
— — 2"=| |£c av 1 1 (sin#j sin6cos($ — ^)+cos 6 cos 6j) — — , 
dti 3 N 

that is positive if 0j = and <f>j = <!> and is negative if 
0j = it — and <j)j — <f> + 7T. As a consequence, a small 
variation 80 j at critical points where M ^ increases 
the value of V if 9j = and cfij — and decreases the 
value of V if 9 3 ■ = n — and <j>j = $ + 7r. 
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We conclude that £'(0) (the set of relative equilibria cor- 
responding to parallel motion) is asymptotically stable 
in the shape space and the other positive limit sets are 
unstable. ■ 

B Proof of Theorem 2 

S is non negative and, from (20), it is non-increasing 
along the solutions of (2). Then S converges to a limit as 
t — > oo. Furthermore the second derivative 5* is bounded 
(because — v av is bounded for every k). From Bar- 
balat's Lemma S — > when t — > oo and therefore the 
solutions converge to the set T where 

(v a k -v a av )xx k = 0, (B.l) 

that characterizes the equilibria of (21). Observe that in 
r, % = Uo x Xk and v% is constant for k = 1, . . . , N. 
Therefore T C S(u>o). It remains to prove that the set 
E(uj ) is asymptotically stable (in the shape space) and 
the other sets (in T) are unstable. 

We divide the analysis into three parts to analyze T. 

i) Suppose that in steady state u> x x k ^ for every k. 
Then (B.l) can hold only if v% = v for every k and for 
some fixed Vq £ R 3 , this set defines a global minimum 
for S and therefore is asymptotically stable in the shape 
space. This set corresponds to circular or helical relative 
equilibria (with axis of rotation parallel to uj ) and is 
contained in E(lj ). 

ii) Suppose now that in steady state x k = Wo x x k = 
for every k. From (B.l) we obtain 

« - < v ) ^„ = 

for every k, which implies (r k — r av ) x u>o = 0. Therefore 
in steady state the Lyapunov function (18) reduces to 

1 N 

S = 2^11^-^-11 • (B.2) 
fc=i 

This set is characterized by the vectors x k , k = 
1, . . . ,N, all parallel to the constant vector ojq. Note 
that this configuration involves N — K velocity vectors 
aligned to uj a and K velocity vectors anti-aligned to uj 
(or vice- versa), where < K < y . When K = 0, poten- 
tial (B.2) is zero (global minimum), and therefore the 
configuration defines an asymptotically stable set. This 
set corresponds to collinear formations (with the same 
direction of motion) parallel to lj . These configurations 
are relative equilibria and are contained in E(u> ). 

When K — y, potential (B.2) attains a global maxi- 
mum, and therefore the configuration defines unstable 



equilibria. Every other value of K corresponds to a sad- 
dle point and is therefore unstable. To see this it is suffi- 
cient to express x k and u> in spherical coordinates and 
to show that S can decrease under an arbitrary small 
perturbation (see the proof of Theorem 1). 

iii) It remains to analyze the situation where wq x x^ ^ 
for k e Gi and uj x Xj = for j e G 2 , where G\ 
and G2 denote two disjoint groups of particles such that 
G1UG2 = {l,...,JV}and|Gi| - Mand |G 2 | = N-M. 
In such a situation we obtain 

v% -vt v = 0, ke Gi 
{v* -< v ) x wo = 0, j e G 2 , 

where ^ o° v , j £ G 2 . We call this set A. Since 

keGi jeG 2 
from (B.3) we observe that 

V&v = N-M ^ Vj ' 

jeG 2 

that implies that (r k - J] feeG2 r fc ) xu o = for 

every k e G 2 . 

Therefore in this set the Lyapunov function (18) reduces 
to 

~ S =\ E ll^-^v 2 !! 2 (B.4) 

fe£G 2 

where xf v 2 = J2 keG2 x k . Since ^ a ^ < v , and ^ 

is parallel to u> for every j e G 2 , Xj 7^ a;^, 2 for every 
j € G 2 . We conclude from (B.4) that this set does not 
correspond to global minima of (18). Now we prove that 
this set is unstable. The first step is to show that this set 
does not correspond to local minima of (18). To this end 
we express the velocity vectors and the rotation vector 
in spherical coordinates: 

x k = [cos<j) k sm9 k ,sm(f)kSm6k,cos9 k ] T , 

and 

u)q = [cos<I>sin6,sin<I>sin6,cosO] T , 

where 6 k , Q <G [0, n] and 4> kl $ <E [0, 2ir), and we compute 
the second partial derivative of (18) with respect to a 
particular direction. Let x p ,p £ G 2 , be a velocity vector 
such that x p = — iffiii (notice that such a vector always 

exists since Xj ^ x a ^ for every j £ G 2 ). We show that 
the second derivative with respect to 9 P is negative in this 
set. After some calculations we arrive at the following 
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expression: 



C Proof of Theorem 3 



d 2 s 
del 



N 

E< 

k = l 



d 2 (x k - x av ) 



de 2 p 



+ 



d(x k - x av ) 



+ < 



oe p 

d 2 {x k - x a 



de 2 p 



,{r k -r av ) x w > . 



Let q = {x 1 r) be a point belonging to A. By using the 
relations (B.3) (characterizing the set A) we observe that 
in the set A the following conditions hold 



The function B = Q + S is non negative and it is non- 
increasing along the solutions of (2) with the control law 
(23) . Then B converges to a limit as t — > oo. Furthermore 
the second derivative B is bounded (because — v av is 
bounded for every k). From Barbalat's Lemma B — > 
when t — > oo and therefore the solutions converge to the 
set where 



vt-vt v+ [ < ^ X - > -n 



ll w o|| / ||w | 

The x dynamics in this set reduce to 



x x k = 0. 
(C.l) 



x k - x av = (r k - r av ) x u> , 
(r k - r av ) x wo = 0, 



feed 
fee G 2 . 



this yields 



8 2 S 

de 2 p 



N - 1 
N 2 



dXr 



de ri 



n - 1 a 2 ^ 



N 



de 2 p 



+ 



(7V-1) 2 



AT2 



dx. 



de v 



E 



1 9 2 a; t 



n del 

k£G 2 \p p 



(B.5) 



Since £c a 



|wo| 



< a < 1 and 



A, the expression (B.5) reduces to 



d 2 x p 

~dffj 



l^ol 



d 2 s 
de 2 p 



N-l . N 
-^-(« + !)- 

(AT-M-1) 



1 (A^-l) 2 



N 2 



—a- 



N 



which shows that (18) does not attain a local minimum 
in the set A. Let Aq be the connected component of 
A containing q. Consider a neighborhood B{q) in the 
shape space such that B(q)\hq contains no points where 

5 = 0. Choose a point q <G B(q) such that S(q) < S(q). 
Since the function S decreases along the solutions, the 
solution with initial condition q cannot converge to Aq 
and leaves B(q) after a finite time. Since S is not at a 
local minimum in Aq we can take q arbitrary close to q 
which shows that q is unstable. 

We conclude that the set E(u} ) is asymptotically stable 
in the shape space and that the other positive limit sets 
are unstable. ■ 



x k = u> x x k 



1. 



Following the same lines of the proof of Theorem 2, we 
analyze the stability of the positive limit sets, 
i) Suppose that ujq x x k =/= for every k. Then the 
only possible way for (C.l) to hold is that v k — v av + 

( << 1|u^lT > ~ a )|l^TT = for every k - Factorin g thc 
first term in parallel and orthogonal components (with 
respect to «o) we obtain 



< x k - a; av , w > 



<w .a; av ; 
IIWoll 



WW 



X ((«fc - <v) X W ) 



a 



Up 

IIWol 



= 0, 



l^oll 



a and v% = v a aY 



which implies that < x kl ujQ > 
for every k. The second condition tell us that a relative 
equilibrium is reached while the first says that the pitch 
of every particle is fixed to the desired value a. Since 
in this set the Lyapunov function attains a global mini- 
mum we conclude that the set of relative equilibria with 
rotation vector u>o and pitch a is asymptotically stable 
in the shape space. 

ii) Suppose that w x x k ^ for k e G\ and u> xxj = 
for j e G*2, where G\ and Gi are defined in the proof of 
Theorem 2. In such a configuration we obtain 



„o_„a | ( <U) a ,X m > 
V k ^av + l HWoll "''IIWoll 

(v- - < y ) X W = 



a)-. 



0, 



k e d 



where ^ v^ v , j E G 2 - Following the same lines of the 
proof of Theorem 2, it can be shown (by calculating thc 
second derivative of the Lyapunov function with respect 
to a suitable direction) that the set defined by this con- 
figuration is unstable (unless | C2 1 = that is the case 
considered in the point i)). ■ 

D Proof of Theorem 4 

To show that the resulting closed-loop vector field is 
invariant under an action of SE(3), it is sufficient to 
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observe that the dynamic control law (28) depends only 
on the relative orientations and relative positions of the 
particles. With the change of variables u>£ = Rk^k (28) 
rewrites to 

u k = Rl ("1 + [K - r av ) x ljI - x av ] x ajfe), (D.la) 



N 

E 



(D.lb) 



We observe that (D.lb) is independent of the par- 
ticle dynamics. Therefore the solutions of (D.lb) 
will exponentially converge to a consensus value 

w av = EjLi Lc - w fe w av when i -> oo, 

for every fc = 1,2, ... , iV. Therefore (D.la) asymptoti- 
cally converge to 



u k = Rl (uj av + [{r k - r av ) x w a 



x ajfe) . 



The positive limit sets (in the shape space) for system (2) 
with the control law (D.2) have been analyzed in The- 
orem 2 and we already know that E(u> av ) is an asymp- 
totically stable set. Therefore system (2) with (D.l) is a 
cascade of an exponentially stable system and a system 
with an asymptotically stable set (in the shape space) 
E(uj av ). From standard results (see e.g. [28,29]) we con- 
clude that E x Cu; is a stable attractor, in the shape 
space, for the cascade system. The instability of the other 
positive limit sets follows from Theorem 2. ■ 

E Proof of Proposition 2 

Following the same lines of the proof of Theorem 2 we ob- 
serve that the only asymptotically stable equilibria of the 
v dynamics are relative equilibria of (2) . These configu- 
rations are characterized by v k — v av , k — 1,2, ... ,N. 

Since v av = ^feLi v k + v o) > we conclude that 

v? = Vo,k = l,2,...,N. ' M 



F Proof of Theorem 6 

Since the control law does not depend on the relative 
spacing, we analyze the reduced dynamics on relative 
orientations. Set b k — Rkbk- Then b a (t) obeys the con- 
sensus dynamics b = —L(t)b a , which implies that its 
solutions exponentially converge to a consensus value b . 
Therefore, the control law 



u k = Rl{x k x b%), 
asymptotically converges to the control 
u k = Rl(x k x b ), 



(F.l) 



(F.2) 



for every k — 1,2, ... ,N. The limiting system is decou- 
pled into N identical systems whose limit sets (of the 



\bo\ 



or 



reduced dynamics) are characterized by x k 
x k = — for every k. The synchronized set x k = 

\\°o\\ 

is exponentially stable while the set characterized 

ll°°ll 

by Xk = ~ rrj~rj is unstable. Therefore system (2) with 



IN, 

(D . 1) is a cascade of a uniformly exponentially stable sys- 
tem (in the shape space) with a system with an asymp- 
totically stable set (in the shape space). From standard 
results on stability of cascade systems, we conclude that 
£■(0) x Cfj is a stable attractor, in the shape space, for 
the cascade system. The instability of the other positive 
limit sets follows from the instability of the correspond- 
ing limit sets in the (limit) decoupled dynamics. ■ 



G Proof of Theorem 7 



Observe that with the change of variables u> k 
RkWk, K = Rkbk, c a k = RkC k + r k (39) rewrites to 



u k = Rl K + [(ffc - eg) x u> a k - b%) x x k ) 



w2 = -£f=i£/w(*K 



c2 = -£f=i£/w(*K 

and the consensus dynamics are not influenced by the 
particles dynamics. Therefore, from Theorem (5), we 
conclude that the variables u>£ , b k and c£ asymptotically 
converge to the consensus values u; ,bo an d c respec- 
tively, and the particles' dynamics become asymptoti- 
cally decoupled. The dynamics of the decoupled system 
can be easily characterized defining the Lyapunov func- 
tion 

N 



\n-v \ 



k=l 



where v = c x lj + b a and v k = rk x lj + x k . Now 
observe that V is non increasing along the solutions of 
the decoupled system: 



V = 



N 

Ei 

fc=i 



(Wfe-Wo) x x k \ 



that is sufficient to conclude that the set of relative 
equilibria with rotation vector u>o and v k = Vq, k — 
1,2,...,N is asymptotically stable for the uncoupled 
dynamics. Following the same lines of the proof of The- 
orem 6, we conclude that the set E x Cm x x Cc 
is asymptotically stable in the shape space. The insta- 
bility of the other limit sets follows from the instability 
of the corresponding limit sets in the (limit) decoupled 
dynamics. ■ 
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